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ABSTRACT 

The similarity of item and ability parameter 
estimations was investigated using two numerical analysis techniques 
via marginal maximum likelihood estimation (MMLE) with a large 
simulated data set (n-1,000 examinees) and changing the number of 
quadrature points. MMLE estimation uses a numerical analysis 
technique to integrate examinees' abilities over the ability 
distribution for item and ability parameter estimations because of 
the difficulty of direct integration with a digital computer. For 
integrating ability, the values of quadrature points and the weights 
corresponding to each quadrature point are specified. The 
Gauss-Hermite quadrature formula and R. J. Mislevy's histogram 
solution (1984) have been used for numerical integration over the 
normal density function. It was determined that the Gauss-Hermite 
quadrature formula and Mislevy's graphical solution via MMLE 
estimated item and ability parameters equally when a large number of 
quadrature points was specified. When a small number of quadrature 
points was specified, Mislevy's histogram solution via the HMLE 
approach estimated item and ability parameters more accurately than 
did the Gauss-Hermite quadrature formula. Seven tables summarize the 
study. (Author/SLD) 
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validity o£ using Two Numerical Analysis Techniques to 
Estimate Item and Ability parameters via MMLE: Gauss-Hermite 
Quadrature formula and Mislevy's Histogram Solution. 

Abstract 

MMLE employs a numerical analysis technique to integrate 
examinee's abilities over the ability distribution for item and 
ability parameter estimations because of the difficulty of direct 
integration with a digital computer. For integrating ability, 
the values of quadrature points and the weights corresponding to 
each quadrature point are specified. The Gauss-Hermite 
quadrature formula and the Mislevy's histogram solution have been 
used for numerical integration over the normal density function. 

This study found that the Gauss-Hermite quadrature formula 
and the Mislevy's graphical solution via MMLE estimated item and 
ability parameters equally when the large number y£ quadrature 
points were specified. When the small number of quadrature 
points are specified, the Mislevy's histogram solution via MMLE 
approach estimated item and ability parameters more accurately 
than the Gauss-Hermite quadrature formula. 



I. introduction 



There are many procedures to estimate item and ability 
parameters. Birnbaum's joint estimation paradigm (1968) has been 
the standard procedure for the maximum likelihood estimation of 
item and ability parameters. Because of the incidential and 
structural problem in JMLE, Bock and Lieberman (1970) proposed 
marginal maximum likelihood estimation (MMLE) to remove the 
effect of incidental parameters by integrating over the ability 
distribution. 

MMLE employs a numerical analysis technique to integrate 
examinee's abilities over the ability distribution because of the 
difficulty of direct integration with a digital computer. Under 
the numerical analysis theory, the problem of finding the sum of 
the area under the continuous curve is replaced by the simpler 
problem of finding the sum of the areas of a finite number of 
quadratures which approximate the area under the curve. 

The MMLE approach and a numerical analysis theory have been 
implemented in the BILOG computer program (Mlslevy and Bock, 
1982, 1984, 1986). For integrating ability, the number of 
quadrature points, the values of quadrature points, and the 
weights corresponding to each quadrature point are specified. 
The Gauss-Hermlte quadrature formula h^s been used for numerical 
integration over the normal density function. The table, due to 
Stroud and Secret (1966), for quadrature points and weights are 
used in the MMLE approach (Bock & Aitkin, 1981; Bock & Lieberman, 



1970; Mislevy, 1984). The BILOG computer program does not 
actually provide the quadrature points and weights yielded by the 
Gauss -Her mite formula. The quadrature points and weights 
provided as the default values for normal density function in 
BILOG are based upon the graphical solution which is called 
Mislevy's histogram solution (Mislevy & Stocking, 1989). 

Seong (in press) found that increasing the number of 
quadrautre point improves the accuracy of estimation for item and 
ability parameter with a large data set when prior ability 
distributions were matched to underlying ability distributions. 
This study investigated similarity of item and ability parameter 
estimations of using above two numerical analysis techniques via 
MMLE with a large data set after changing the number of 
quadrature points. 



An approximate integration is used when we are solving a 
functional equation for an unknown function that appears in the 
integrand of aome integral and we are confronted with the problem 
of integrating experimental data. In a numerical analysis, an 
integral is approximated by a linear combination of the value of 
the integrand. 

fb n 



II. Theory 




(1) 
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are points or abscissas usually chosen so as to 
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lie In the Interval o£ Integration. These are called the nodes 
or quadrature points. A(x^), A(X2 ) / . .A(x^ ) ^^^n^ 

called weights or coefficients corresponding to quadrature 
points. The right side of the above equation Is frequently 
called a rule of approximate Integration, or quadrature formula 
or quadrature rule. A quadrature formula usually occurs In 
families depending upon a parameter such as the spacing between 
the Integrand quadrature points or the number of the these 
points. With arbitrary nodes, formula (1) will be exact for all 
polynomial of degree i n-1. 

The great mathematician Karl Frledrlch Gauss (1866) 
discovered that the accuracy of the numerical integration process 
could be greatly Increased for the special case w(x) = 1 by a 
special placement of the nodes. The quadrature formulas that 
arise through application of his theorem are called Gaussian 
quadrature formulas. 

Gauss-Hermite Quadrature Formula 

There is a large family of numerical integrations that 
confirm to following pattern of the formula (1). 
For using the above formula, it is only necessary to know the 
"quadrature points" x^, x^/ . .x^, . . .x^ and "weights" A(x^), 
A(X2),.. A(x^ ) , . . .A(x^) . Gauss's remarkable results is given 
below (see Cheney & Klncald, 1985 pp 192 for details): 

Let q be a polynomial of degree n such that 





(2) 
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Let x^, .Xj^ be the roots o£ q. Then the formula (1) 

with these Xj^'s as nodes will be exact for all polynomials of 
degree < 2n-l. With Gaussian nodes, the formula will be exact 
for all polynomials of degree i 2n-lo The quadrature formulas 
that arise as applications of this theorem are called Gaussian 
quadrature formula. There is a different formula for each 
interval (a, b) and each of n. There is also more general 
Gaussian formula to give appropriate values of integrals such as 



I<» -X fl Vt foo 

f(x)e dx, f(x)(l-x*) dx, f(x) 
0 Ja J-oD 



-x^ 



e dx, etc. 



Over the doubly infinite interval (-<» < x < <»), a frequently 
used weighing function is of the form 

-a* X* 

w(x) = e . (3) 

Quadrature formula with above function is 

I«> tea -a^x* n 

w(x)f(x)dx = e f (x)dx ss E H. f(x.) + E. (4) 
-co J-00 i = i ' » 

Hermite provided the relevant orthogonal polynomial equation 
to compute the nodes when a =1 or a =% (see Hildebrand, 1956, pp 
277 for details). Hermite's orthogonal polynomial equation is 
given below: 

n x2 3^ -x2 
(x^) = (-1) e (e ) = 0 (5) 

where n is the number of nodes (quadrature points). 

The first four of the polynomials defined by Equation (5) 
calculate the values of the nodes as shown below: 



Hq(X)=1 

Hj^(x^)=2x 0, 

H2(Xj^)=4x^-2 x^= ± 

H3(x^)=0x^-12x X = ± /3/2 and 0. 

These values are given in the Stroud and Secrest's (1966) Table 
5, Hermite's equation to compute weight corresponding each node 
is (see Hildebrand, 1956, pp 277 for details): 

2 n! / Tc 
[H^^,(x^)l2 . 

When there are two nodes, the equation for computing the weights 
is 

2"^ 2! /T 



"2 = 

[H3 (x^)]-^. 

The weights corresponding two nodes are + /tc/2. when there are 
three nodes, the weights are ±/Tt/6 and 2/tc/3. These values of 
weights are given in the Stroud and Secrest's Table 5 (1966). 
From the Equation (4), 



\ 



» -X* n 

e f (x)dx E H, f (X, ) + E. 
-09 i=l * * 



The quadrature formula of a normal function is 



1 foo ~y}/2 n 

All J -«o 



g(x)dx 2S E H.g(x. ) + E. (7) 
i=l ^ * 



^8 



Let X = /Ty, dx « /r dy. 



1 foo -x*/2 /T f«, -yi 

— e g(x)dx = — - e g(/2*y)dy 



1 foo -y2 

— e g(/r y)dy. (8) 

tt J -co 



Let /T^y = j(y) and h =» g.j. 



1 fw -x*/2 1 r« -y* 

— e g(x)dx = -— - e glj(y)]dy 

'IXi J -» J -00 



1 foo -y^- 

e h(y)dy 



1 f«) 
/it J -00 



1 n 



— • E H. h(Xi) 
/tT i=l * * 



1 n 

= -— E H. g(/rx. ) 
n 1 

= E — - H, g(/2xv) (9) 
n 

E H. g(X|). 

1 

From the above equation, H* = Hj , and x. = /T X|^ . 

The nodes of the normal function are obtained by multiplying the 
Stroud and Secrest's Table 5 values by /l. The weights of the 
normal function are obtained by dividing the Stroud and Secrest' 
Table 5 values by /tT. 



Mlsl6vy's histogram solution 

Under a normal distribution, the ability scale is restricted 
from -4 to +4 and the ability Interval is divided into (n~l) 
numbers of rectangles having equal ability space, n indicated a 
specified number of quadrature points. It produces the specified 
number of quadrature points. 

The normal probability density functions at each X^, f(x^), 
are computed and then multiplied by the equal space, which is the 
width of the rectangle. These are values of weights, A(Xj^). The 
sum of these weights values is i. When the sum of the weights is 
not exactly equal to 1 because of rounding error. The weights 
are divided by the sum of the weights to make that sum of the 
weights equal to 1. The default values of quadrature and weights 
satisfy three conditions for numerical integration of the normal 
distribution which are ZMX^) = 1, EX^A(X^) = 0, and ExJ A(X^) 
= 1. 

III. Method 

Data 

Simulated item response vectors (1,0) for 1,000 examinees 
were generated by the GENIRV computer program (Baker, 1978). The 
program requires an user to specify the number of items in a 
test, the values of item parameters, the sample size, and the 
type of underlying ability distribution. A test of 45 items was 
used in the present study because this number of items was large 
enough to yield stable results, item parameters of the 45- Items 
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for generating item response vectors under the two-parameter 
normal ogive ICC model were randomly chosen from within each cell 
of Table 1. Thirty one ability groups were used for the normally 
distributed 1,000 examinee data because these groupings and 
numbers of examinees yielded a good match to the normal ability 
distributions . 

(Insert Table 1 about here] 

Item and Ability Parameter Estimation 

The generated data set was analyzed via the micro computer 
version of the BILOG (PC-BILOG version 1.1) program (Mislevy & 
Bock, 1986) specifying the number of the quadrature points, the 
values, and the weights. Most of the program default values were 
used except the number of quadrature points, the values of the 
quadrature points, and weights corresponding to each quadrature 
point by the Gauss-Hermite quadrature formula and the Mislevy' s 
histogram solution. The number of the quadrature points for this 
study were 10, 20, 30, and 40. 

For ability estimation, the Bayesian expected a posterior 
estimation (EAP) was chosen because no other estimator has 
smaller mean square error ove^. he population for which the 
distribution of ability is specified by the prior (Bock & 
Mislevy, 1982; Mislevy & Stocking, 1989). 

Similarity Measures 

Tw statistics were used to measure a similarity of item and 
ability parameter estimations of using two numerical analysis 
techniques, one is the correlation between the parameters and 
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the estimates o£ using the Gauss-Hermlte quadrature formula and 
the Mlslevy's graphical solution. Another Is the absolute 
difference between the parameters and the estimates of using two 
numerical analysis techniques. 

IV. Results and Conclusions 
Item Discriic.ination Estimates 

The correlations and the average absolute difference for item 
dl:iC£ imlnation estimate were reported in Table 2 and Table 3. 
(Insert Table 2 and Table 3 about herel 
The correlations between the item discrimination parameters 
and the estimates of using the Mlslevy's graphical solution were 
almost equal to those between the item discrimination parameters 
and the estimates by using the Gauss-Hermlte quadrature formula. 
The average absolute difference of the item discrimination 
estimates by using the Mlslevy's histogram solution were smaller 
than those by using the ("auss-Hermite quadrature formula when the 
number of quadrature points were small. 
Item Difficulty Estimates 

The correlations and the average absolute difference for item 
difficulty estimate were reported in Table 4 and Table 5. 

[Insert Table 4 and Tf>ble 5 about here] 
The correlations between the item difficulty parameters and 
the estimates by using the Mislevy's graphical solution were 
exactly equal to those between the item difficulty parameters and 
the estimates by using the Gauss-Hermite quadrature formula. 
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When the number oc quadrature points was ten, the average 
absolute difference for the item difficulty estimates of using 
the Mislevy's histogram solution was smaller than that of using 
the Gauss-Hermite quadrature formu 
Ability Bdtimates 

The correlations and the average absolute difference for 
ability estimate were reported In Table 6 and Table 7. 

[Insert Table 6 and Table 7 about here] 
When ten quadrature points were chosen, the correlation 
between the ability parameters and the estimates of using the 
Mislevy's histogram solution was larger than that of using the 
Gauss-Hermite quadrature formula. The average absolute 
difference for ability estimate of using the Mislevy's histogram 
solution were smaller than those of using the Gauss-Hermite 
quadrature formula when the number of quadrature points were ten 
and twenty. 

When the small number of quadrature points are specified., the 
Mislevy's histogram solution via MMLE approach estimates Item and 
ability parameters more accurately than the Gauss-Hermite 
quadrature formula. The choice of numerical analysis technique 
may not be an important consideration for item and ability 
parameter estimations via MMLE when the large number of 
quadrature points are chosen. When estimating Item and ability 
parameters via MMLE with small number of quadrature points, this 
study suggests using the Mislevy' histogram solution rather than 
the Gauss-Hermite quadrature formula. 

11 
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Table 1 
Item Parameters of 45 Items 



Item 
discr 1 . 
(«) 



Item difficulty (0 ) 





-1.00 


0.00 


+ 1.00 


Total 


.3 - 


.5 


5 


5 


5 


15 


.6 - 


.8 


5 


5 


5 


15 


.9 -1 


.1 


5 


5 


5 


15 


Total 




15 


15 


15 


45. 
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Table 2 



Correlations between the Item Discrimination Parameter and 
the Estimates of Using the Gauss-Hermlte Quadrature Formula 
and the Mislevy's Histogram Solution, 

Numerical Analysis Technique 
Gauss-Hermlte Mislevy's 



10 .9eO .981 

Number of 20 .980 .981 
Quadrature 

Points 30 .981 .981 

40 .981 .981 



Table 3 



Average Absolute difference for the Item Discrimination 
Estimates of Using the Gauss-Hermlte Quadrature Formula and 
the Mislevy's Histogram Solution. 



Numerical Analysis Technique 
Gauss-Hermlte Mislevy's 



10 .067 .051 

Number of 20 .039 .038 
Quadrature 

Points 30 .038 .038 

40 .038 .038 
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Table 4 



Correlations between the Item Difficulty Parameters and 
the Estimates o£ Using the Gauss-Hermite Quadrature Formula 
and the Mislevy's Histogram Solution. 

Numerical Analysis Technique 



Gauss-Hermlte Mislevy's 

10 .992 .992 

Number of 20 .992 .992 

Quadrature 

Points 30 .992 .992 

40 .992 .992 



Table 5 



Average Absolute difference for the Item Difficulty 
Estimates of Using the Gauss-Hermite Quadrature Formula and 
the Mislevy's Histogram Solution. 

Numerical Analysis Technique 
Gauss-Hermite Mislevy's 



10 .101 .086 

Number of 20 .078 .078 
Quadrature 

Points 30 .078 .078 

40 .078 .078 
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Table 6 



Correlations between the Item Ability Parameters ana the 
Estimates of Using the Gauss-Hermite Quadrature Formula and 
the Mislevy's Histogram Solution. 

Numerical Analysis Technique 



Gauss-Hermite Mislevy's 

10 .951 .953 

Number of 20 .957 .957 

Quadrature 

Points 30 .957 .957 

40 .957 .957 



Table 7 



Average Absolute difference for the Ability Estimates o£ 
Using the Gauss-Hermite Quadrature Formula and the Mislevy's 
Histogram Solution. 

Numerical Analysis Technique 



Gauss-Hermite Mislevy's 

10 .260 .248 

Number of 20 .232 .230 

Quadrature 

Points 30 .230 .230 

40 .230 .230 
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